Coded Parallel Transmission for Half-Duplex Distributed Computing

نویسندگان

چکیده

This work studies a general distributed coded computing system based on the MapReduce-type framework, where nodes within half-duplex network wish to compute multiple output functions. We first introduce definition of communication delay characterize time cost during date shuffle phase, and then propose novel coding strategy that enables parallel transmission among computation by delicately designing data placement, message symbols encoding, shuffling, decoding. Compared (CDC) scheme proposed Li et al., significantly reduces delay, in particular when load is relatively smaller than number K. Moreover, CDC monotonically increasing function K, while our decreases as K increases, indicating can make better use resources.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Coded Computing for Distributed Graph Analytics

Many distributed graph computing systems have been developed recently for efficient processing of massive graphs. These systems require many messages to be exchanged among computing machines at each step of the computation, making communication bandwidth a major performance bottleneck. We present a coded computing framework that systematically injects redundancy in the computation phase to enab...

متن کامل

Full-Duplex Relaying with Half-Duplex Relays

We consider “virtual” full-duplex relaying by means of half-duplex relays. In this configuration, each relay stage in a multi-hop relaying network is formed by at least two relays, used alternatively in transmit and receive modes, such that while one relay transmits its signal to the next stage, the other relay receives a signal from the previous stage. With such a pipelined scheme, the source ...

متن کامل

Locality Abstractions for Parallel and Distributed Computing

Virtual Processor Fig. 1. The Sting software architecture. VPs, and (c) performs initial thread placement on the VPs de ned within a given virtual machine . Just as VPs context switch threads, a physical processor will context switch virtual processors because of preemption, or because a VP speci cally requests a context switch (e.g., because of an I/O call initiated by its current thread). We ...

متن کامل

PVM: A Framework for Parallel Distributed Computing

The PVM system is a programming environment for the development and execution of large concurrent or parallel applications that consist of many interacting, but relatively independent, components. It is intended to operate on a collection of heterogeneous computing elements interconnected by one or more networks. The participating processors may be scalar machines, multiprocessors, or special-p...

متن کامل

Parallel and distributed computing for data mining

Similar scenarios will occur in other areas: we will see large numbers of radiological images generated in hospitals and immense product and customer databases as the Internet and e-commerce continue to expand.1 Exploring useful information from such data will require efficient parallel algorithms running on high-performance computing systems with powerful parallel I/O capabilities. Without suc...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Information

سال: 2022

ISSN: ['2078-2489']

DOI: https://doi.org/10.3390/info13070342